Convergence rate determination for gradient-based adaptive estimators
نویسندگان
چکیده
A convergence rate estimate is derived for the homogeneous gradient-based adaptive linear estimator algorithm. This estimate involves the eigenvalues of the regression vector covariance matrix, yielding a useful measure for thechoice of input signals for adaptive parameter estimation. The connection between this criterion and those more familiar from nonadaptive system identification is made and comparisons are drawn behueen the hvo areas.
منابع مشابه
Adaptive Markov Chain Monte Carlo Confidence Intervals
In Adaptive Markov Chain Monte Carlo (AMCMC) simulation, classical estimators of asymptotic variances are inconsistent in general. In this work we establish that despite this inconsistency, confidence interval procedures based on these estimators remain consistent. We study two classes of confidence intervals, one based on the standard Gaussian limit theory, and the class of so-called fixed-b c...
متن کاملNonparametric estimation of two dimensional continuous-discrete density function by wavelets with an application to competing risks
We consider the estimation of a two dimensional continuous-discrete density function with applications to competing risks. We construct two new wavelet estimators (non-adaptive and adaptive) for the joint density function taking into account this special continuous-discrete structure. The rates of convergence of the proposed estimators are established under the L2 risk over Besov balls. Our mai...
متن کاملImproving the Convergence of the Backpropagation Algorithm Using Learning Rate Adaptation Methods
This article focuses on gradient-based backpropagation algorithms that use either a common adaptive learning rate for all weights or an individual adaptive learning rate for each weight and apply the Goldstein/Armijo line search. The learning-rate adaptation is based on descent techniques and estimates of the local Lipschitz constant that are obtained without additional error function and gradi...
متن کاملRecovery-Based Error Estimator for Interface Problems: Conforming Linear Elements
This paper studies a new recovery-based a posteriori error estimator for the conforming linear finite element approximation to elliptic interface problems. Instead of recovering the gradient in the continuous finite element space, the flux is recovered through a weighted L2 projection onto H(div) conforming finite element spaces. The resulting error estimator is analyzed by establishing the rel...
متن کاملEstimation of spectral bounds in gradient algorithms
We consider the solution of linear systems of equations Ax = b, with A a symmetric positive-definite matrix in R, through Richardson-type iterations or, equivalently, the minimization of convex quadratic functions (1/2)(Ax, x) − (b, x) with a gradient algorithm. The use of step-sizes asymptotically distributed with the arcsine distribution on the spectrum of A then yields an asymptotic rate of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Automatica
دوره 22 شماره
صفحات -
تاریخ انتشار 1986